Note on the greedy parsing optimality for dictionary-based text compression
نویسندگان
چکیده
Dynamic dictionary-based compression schemes are the most daily used data compression schemes since they appeared in the foundational papers of Ziv and Lempel in 1977, commonly referred to as LZ77. Their work is the base of Deflate, gZip, WinZip, 7Zip and many others compression software. All of those compression schemes use variants of the greedy approach to parse the text into dictionary phrases. Greedy parsing optimality was proved by Cohn et al. (1996) for fixed length code and unbounded dictionaries. The optimality of the greedy parsing was never proved for bounded size dictionary which actually all of those schemes require. We define the suffix-closed property for dynamic dictionaries and we show that any LZ77-based dictionary, including the bounded variants, satisfy this property. Under this condition we prove the optimality of the greedy parsing as a variant of the proof by Cohn et
منابع مشابه
On the optimality of parsing in dynamic dictionary based data compression preliminary version
Since the introduction of dynamic dictionary based data compression by Ziv and Lempel two decades ago many dictionary construction schemes have been proposed and implemented This paper considers the following question once a dynamic dictionary construction scheme is selected is there an e cient dynamic parsing method that results with the smallest number of phrases possible for the selected sch...
متن کاملImplementation and Experimental Evaluation of Flexible Parsing for Dynamic Dictionary Based Data Compression
We report on the implementation and performance evaluation of greedy parsing with lookaheads for dynamic dictionary compression Speci cally we consider the greedy parsing with a single step lookahead which we call Flexible Parsing FP as an alternative to the commonly used greedy parsing with no lookaheads scheme Greedy parsing is the basis of most popular com pression programs including unix co...
متن کاملDictionary Compression on the PRAM
Parallel algorithms for lossless data compression via dictionary compression using optimal, longest fragment rst (LFF), and greedy parsing strategies are described. Dictionary compression removes redundancy by replacing substrings of the input by references to strings stored in a dictionary. Given a static dictionary stored as a su x tree, we present a CREW PRAM algorithm for optimal compressio...
متن کاملParsing Algorithms for Data Compression
The task of parsing consists of splitting an input text into a sequence of contiguous phrases. Several classes of data compression algorithms rely on parsing techniques either to identify repetitions inside the input string (dictionary-based compression) or to locate homogeneous pieces of data which are separately compressed (PermutePartition-Compress paradigm). In these applications, the choic...
متن کاملParsing with Su x and Pre x
We show that greedy left-to-right (right-to-left) parsing is optimal w.r.t. a suux (preex) dictionary. To exploit this observation, we show how to construct a static suux dictionary that supports on-line, linear-time optimal parsing. From this we derive an adaptive on-line method that yields compression comparing favorably to LZW.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Theor. Comput. Sci.
دوره 525 شماره
صفحات -
تاریخ انتشار 2014